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Abstract 

We study the diversity of complex spatio-temporal patterns of random synchronous asymmetric 
neural networks (RSANNs). Specifically, we investigate the impact of noisy thresholds on network 
performance and find that there is a narrow and interesting region of noise parameters where RSANNs 
display specific features of behavior desired for rapidly 'thinking' systems: accessibility to a large set 
of distinct, complex patterns. 
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Q ■ 1 Introduction 

Q . 

Random Synchronous Asymmetric Neural Networks (RSANNs) with fixed synaptic coupling strengths 

and fixed neuronal thresholds have been found to have access to a very limited set of different limit- 
^ ', cycles (Clark, Kiirten & Rafelski, 1988; Littlewort, Clark & Rafelski, 1988; Hasan, 1989; Rand, Cohen & 

P<J ' Holmes, 1988). We will show here, however, that when we add a small amount of temporal random noise 

CO , by choosing the neural thresholds not to be fixed but to vary within a narrow gaussian distribution at each 

time step, we can cause transitions between different quasi-limit-cycle attractors. Shifting the value of 
neuronal thresholds randomly from a gaussian distribution which varies on a time scale much slower than 
r — ' the fast synaptic dynamics, we control the timing of the transition between limit-cycle attractors. Hence 

^^ , we can gain controllable and as we believe biologically motivated access to a wide variety of limit-cycles, 

each displaying dynamical participation by many neurons. 
2 . Perfect limit-cycles in which the network returns to some earlier state do not exist in real biological 

systems, due to many complicating factors: membrane potential noise (Little, 1974; Clark, 1990; Faure, 
1997), the complexity of biological neurons, the continuously- valued signal transmission times between 
^ ■ neurons, and the lack of a clock to synchronously update all neurons, to mention a few. Therefore the case 

Q , of approximate limit-cycles is more biologically reasonable. Indeed, the appearance of limit-cycle behavior 

O ■ in central pattern generators is evidence for such temporal behavior in biological systems (Hasan, 1989; 

Harder & Hooper, 1985). We also believe that the biologically significant limit-cycles are those in which 
a great fraction of the neurons actively participate in the dynamics. 

If these limit-cycles represent brain activity states which we could call 'thoughts', and if a sequence 



j^ ' of spontaneous or externally controlled transitions from one limit-cycle to another limit-cycle represents 

a 'reasoning process', then neural network systems which exhibit a diversity of accessible limit-cycles 
(thoughts) with capability to move rapidly between them could also exhibit a large variety of different 
'trains of thought'. A system which can access many limit-cycles should always be able to access a 
novel mode; hence the system would have the potential to be a creative system. Our current work thus 
demonstrates conditions sufficient to allow access to creative dynamical behavior. 
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In Section 2 we introduce RSANNs along with the concept of threshold noise, as well as the details of 
an RSANN's implementation. In Section 3, we provide the algorithm that contrasts limit-cycles, which 
is of prime importance in our work. In our quantitative investigations we need to introduce with more 
precision concepts which intuitively are easy to grasp, but which mathematically are somewhat difhcult to 



quantify. We define eligibility in Section 4.1 as an entropy-like measure of the fraction of neurons which 
actively participate in the dynamics of a limit-cycle. In order to quantify the RSANN's accessibility 
to multiple limit-cycle attractors, we define diversity in Section 4.2 as another entropy-like measure, 
calculated from the probabilities that the RSANN converges to each of the different limit-cycles. As a 
measure of the creative potential of a system, we introduce the concept of volatility as the ability to 
switch from one particular highly-eligible cyclic mode to many other highly-eligible cyclic modes. We 



mathematically define volatility in Section 4.3 to be an entropy-like measure of the number of different 
limit-cycle patterns easily available to the net, weighted by the eligibility of each limit-cycle attractor. We 
find that in terms of these variables, as the neuronal threshold noise, e, increases, our RSANN exhibits a 
phase transformation at e = ei from a small number to a large number of different accessible limit-cycle 
attractors (Section 4.2), and another phase transformation at e = £2 > ci from high eligibility to low 
eligibility (Section 4.1). Our main result is that the volatility is high only in presence of threshold noise 
of suitable fine-tuned strength chosen between ei < e < £2, so allowing access to a diversity of eligible 
limit-cycle attractors (Section 4.3). 



2 Random asymmetric neural networks with threshold noise 

Random asymmetric neural networks (RSANNs) (Bressloff & Taylor, 1989; Clark, Rafelski & Winston, 
1985; Clark, 1991), with Wij 7^ Wji, differ from symmetric neural networks (SNNs) (Hopfield, 1982), 
and offer considerably more biological realism, since real neural signals arc unidirectional. Due to the 
lack of synaptic symmetry, RSANNs have a non-simple behavior with different limit-cycle attractors 
with possible period lengthsjj LAt '3> At, even with extremely long periods (greater than 10, 000 time 
steps) when the neuronal thresholds have been finely tuned (Clark, Kiirten & Rafelski, 1988; McGuire, 
Littlewort & Rafelski, 1991; McGuire et al, 1992). 

Consider a net of N neurons with firing states which take binary values (i.e. a^ S 0, 1). Each neuron 
is connected to M other pre-synaptic neurons by unidirectional synaptic weights. A firing pre-synaptic 
neuron j will enhance the post-synaptic-potential (PSP) of neuron i by an amount equal to the connection 
strength, Wij. Inhibitory neurons (chosen with probability /) have negative connection strengths. 

If the ith neuron's PSP, Ci, is greater than its threshold, Vi, then it fires an action potential: Ui ~* 1. 
We parametrize the thresholds, Vi, in terms of 'normal' thresholds, V^, a mean bias level, fj,, and a 
multiplicative threshold- noise parameter, /3i: 

h) = (m + A)v^." 

(1) 

If ^ => 1 and f3i —> 0, we recover normal thresholds {Vi => V^). 

In the presence of even a small amplitude of neural-threshold noise effective on the same time-scale 
as the transmission-time of neural impulses from one neuron to the next neuron, the neural net will 
never stabilize into a single limit-cycle attractor. Rather, if the noise amplitude is not too high, the 
net will continually make transitions from one almost-limit-cycle to another almost-limit-cyclen. This 
'non-stationary' characteristic is common to any volatile system, but makes computer simulation and 
characterization difficult because one never knows a priori when the neural network will 'jump' to a 
new attractor basin. In order to maintain stability and make simulation easier, but also for reasonjs of 
biological reality we will give the neural threshold noise a much longer time scale, tg, than the shorter 
signal-transmission/neural-update time scale, Ai. Consequently, for each discrete slow-time threshold- 
update step, ts, there will be several hundred to several thousand fast-time neural- update steps. At, 
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^ At is the time necessary for a neural signal to propagate from one neuron to the next and is assumed to be identical for 
all synapses (McCuUough & Pitts, 1943); hereafter, we will take as the unit of time At = 1, so that a limit-cycle of period 
L will be L time steps long 

^the prefix 'almost' here, permits occasional misfirings 
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Figure 1: A qualitative sketch showing the threshold for neuron #7 {Vr{ts)) and the spatially-averaged 
firing rate, a(t, i^) as a function of slow-time (ts) and in the inset the a(t,ts) as a function of fast-time 
t. 

during which the thresholds Vi{(3i{ts)) are 'quenched' (or do not change) and the neural states ai{t) are 
allowed to change via Eq. 0. Only at the next slow-time step are the thresholds allowed to change, but 
then kept quenched again during the many fast-time neural-update steps, see Figure ll|. We see here the 
evolution of a threshold value and neural activityi on slow-time, ts, while in the insert the fine-structure 
of limit-cycle dynamics as a function of fast-time is displayed. 

For a given limit-cycle search, labelled by the slow-time-scale parameter tg, the neurons initially 
possess random firing states; where the fraction of initially firing neurons is also chosen randomly to be 
between and 1. At a given slow-time step, ts, we initialize the neuronal threshold parameters f3i with 
zero-mean gaussian noise of width, e, where each /3i is chosen independently for all i. 

This 'slow threshold noise' makes biological sense because the concentrations of different chemicals in 
the brain changes on a time-scale of seconds or even minutes, thereby changing the effective thresholds 
of individual neurons on a time scale much longer than the update time. At (milliseconds). Some 
biologists therefore believe that neural thresholds are 'constant' and noiseless (Fitzhugh-Nagumo Model 
(Pei, Bachmann & Moss, 1995)); others unequivocably feel that neurons live in a very noisy environment, 
both chemically and electrically (Little, 1974); a model which includes slow threshold noise varying 
randomly by O{10~^ seems consistent with both points of view - this will be the model developed here. 

Thereafter the firing state ai(t,ts) of the ith neuron as a function of the rapidly-updating time 
parameter t is given by the following equations: 



(2) 



a^{t,ts) = 


= e{c^{t,ts)-v^{ts)) 


(a) 


Ci{t,ts) = 


= J2 Wijaj{t~ At,ts) 


(b) 


V,{ts) -- 


= {^i + P,{ts))Vl> , 


(c) 



where 9 is the step-function. 



2.1 Implementation 



The prescription given above of an RSANN is implemented in a computer program on a fast workstation. 
We update all neuron firing states in parallel, or 'synchronously', as opposed to serial, or 'asynchronous'. 
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updating in which only one neuron or a small group of neurons is updated at a given time step. The 
connection strengths Wij are integers chosen randomly from a uniform distribution, \Wij\ G (0,50000]. 
We have performed a cross-check simulation in which the connection strengths are double-precision real 
numbers, and have found no difference between the integer- valued connection-strength simulations and 
the real-valued connection-strength simulations. The normal thresholds are double-precision numbers. 
We chose K incoming connections per neuron, where K — 10. The fraction of inhibitory connections 
is randomly chosen, here with probability, / = 0.3. We have studied networks with N neurons, where 
N e {10, 20, 30, 40, 50, 100}. The network size is primarily constrained by the extremely long limit-cycles 
or transients which get longer for larger networks, especially when the thresholds are near-'normal', as 
given by V^ in Eq. H. 



2.2 Updating and Limit-Cycle Search 

We simulate slow threshold noise by reinitializing the thresholds via equation |l|, at each slow-time step tg. 
Initially, during this slow-time step tg, the neural firing states are updated by the dynamical equations 
H for Wn = Wo — 128 fast-time steps, t. After the Wn fast-time updates, an iterative computer routine 
carefully scans the record of the spatially-averaged firing rate, a{t,ts), for t G [0, Wn], to check for exact 
periodicity: 

N 

a(t,ts) = jj T, (^iit^ts) (a) ,^. 

a{t + L,ts) = a(i,t.), Vie[0,TV„], (b) 

where the limit-cycle period is is identified to be L. The iterative routine carefully scans each candidate 
limit-cycle to ensure perfect periodicity of a{t,ts) for at least P periods (typically 2 or 4 periods) of 
the limit-cycle. If the scanning routine finds that the spatially-averaged firing rate has converged to a 
limit-cycle (with L < Wn/P, see Figure 0), then we halt the fast-time updating, 'record' the limit-cycle, 
increment the slow-time (is = tg -\- I), give the thresholds new initial conditions by choosing new Pi in 
Eq. m and the neuronal firing states new initial conditions, and begin a new limit-cycle search. On the 
other hand, if the scanning routine finds that the spatially-averaged firing rate has not yet converged to 
a limit-cycle, we then let Wn+i — 2Wn, and update the network for another Wn+i fast-time steps. After 
the updating, the iterative limit-cycle scanning routine searches again for at least P periods of exact 
periodicity oi a{t,ts), but only within the new time-window, t S [iy„,iy„+i]. We repeat this limit-cycle 
search algorithm until we find a limit-cycle, or until Wn = Wmax (where Wmax is typically 4096 or 8192 
time steps), whichever comes first. 

If the limit-cycle period is much shorter than the width of the time-window, 



L«^W=Wn+l-Wn. (4) 

we will observe many more repetitions of the limit-cycle than the requisite P. If no limit-cycle is observed 
during the limit-cycle search, then the RSANN either has a very long transient or a very long period 
limit-cycle, see Clark (1991) or Littlewort, Clark & Rafelski (1988) for a discussion of the correlation 
between transient-length and limit-cycle period. 

3 Limit-cycle comparison 

From the fast-time-averaged single neural firing rates and from estimates of each neuron's neural fast-time 
variance during a limit-cycle, we can compare two limit-cycles found at two different slow-time steps by 
a chi-square measure of the difference between two simulated distributions. 

We will estimate the likelihood that two different limit-cycles (labelled by the slow-time indices tg 
and t'g) belong to different basins of attraction, by comparing the time-averaged single-neuron firing rate 
spatial vectors, Ai(ts) and Ai{t'g), where the subscript i is the spatial index of the neuron. Often, limit- 
cycles with different periods Lits) and L{t'g) will be remarkably similar, with only an occasional slight 
difference between the fast-time recordings of the spatially-averaged firing rates a{t,ts) and a{t,t'^) (see 
eq. 0), caused by an occasional neuron misfiring: 

|A«(i)|^Kt,t,)-«(t,4)|^0(l). (5) 
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(6) 


e (a?) - 


: (ci), and we find that the 
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Conversely, hmit-cycles with the same period, L{ts) = L{t'g), will often have grossly different Ai{ts) and 
Ai{t'^), especially for short-period limit-cycles. 

3.1 Estimate of neuronal time- variance 

We 'record' each limit-cycle's period, L{tg), and its time-averaged single-neuron firing rates, Ai{ts): 

^ W„+AW 

for all nem'ons i (see Figm-e g). Since af = a^ for a^ G {0, 1}, we have {a. 
variance (of a single measurement from the mean), bi{ts), will be: 

b,{t,) = {{a, - {a,)tf)t = {ai{t,ts))t - {a^{t,ts)) 

For Ai ~ 0.5, we find that the standard deviation of a single measurement of the firing state from the 
mean firing rate is \/hi ~ 0.5. However, for different limit-cycle attractors, the difference between firing 
rates of a particular neuron i is \Ai{ts) ~ Ai{t'g)\ ~ 0.05 ^ 0.5. Fortunately, we measure the firing state 
of each neuron many times (AM^ >> 1) to determine the mean firing rate, so we can also estimate the 
variance of the mean, Bi, as: 

B, = hl^W. (8) 

For ISW ^ 1000 and Ai ~ 0.5, this gives a standard deviation of the mean of VS^ ^ 0.01, which is a 
little smaller than the variation seen between different limit-cycle attractors (see Figure g). Therefore, 
we choose to use the variance of the mean, Bi , rather than the variance of a single measurement from 
the mean for our limit-cycle comparison tests. If we choose a longer observation time, AM^, then we can 
better discriminate between different limit-cycles by using x^ test discussed below. 

Since the variance Bi is for Ai — ^ ox Ai = \ (likely when the RSANN has low eligibility), 
a x^ comparison of Aj(is) and Ai(t'^ will be plagued by division-by-zero problems. In this case, a 
maximum likelihood comparison using Poisson statistics (Smith, Hersman & Zondervan, 1993), or maybe 
the Kolmogorov-Smirnov test would be more appropriate. However, in this work, we simply chose to 
'cut-off' the estimate (Eq. 0) of the single-measurement variance before it reaches zero at a value of 
&. min = 0.04. 



3.2 Distinguishing the 'fingerprints' of different hmit-cycles 

Since volatility (which we define below) requires an abundance of very different limit-cycles, we need a 
highly-contrasting measure of whether a given limit-cycle is different than or similar to another limit- 
cycle, or in essence a method of distinguishing between limit-cycles' 'fingerprints'. For each limit-cycle 
(labelled by the slow time ts), we measure each neuron's fast-time-averaged firing rate, Ai^ig) and its 
(cutoff) fast-time variance (of the mean), Bi(ts) (Eq. ^), and apply the weighted chi-square (x^) method 
to decide whether two limit-cycles found at different slow-times, tg and i^, are similar or different: 

N , o 

X [^"^,^^,1^ - 2^ Bi(t,)+B,(t'^) ' W 

i—1 

where N is the number of neurons in the network as well as the number of degrees of freedom for the 
X^-test. Each term in the x^ sum should approximate the square of a gaussian-distributed variable with 
unit variance. The variance of the difference of two gaussian-distributed variables is the sum of the 
individual variances (not the average), as seen in the denominator of the x^ expression. 

If the variance-estimate, Bi(tg), is appropriate and accurate, and if a class of similar limit-cycles have 
gaussian-distributed time- averaged firing rates Ai{tg) , then we can estimate a priori the maximum value 
of x^i^jtsTt'g) for similar limit-cycles. For an A^-neuron network, two similar limit-cycles should have 
(for A^ >> 1) a chi-squared given by: ~)(^{N,ts,t'g) ^ N±\/2N. Accordingly, in order to ensure that most 
of the similar limit-cycles are determined to be similar by the chi-square test, for 'similarity' we demand 
that x^(A^7 ^s,^s) < A + 3\/N. For large A^, chi-square tables indicate that this is approximately a 95% 
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Figure 2: A diagram showing a transient of length 18 fast-time steps and a limit-cycle of period L — 3 
for AW = 15 fast-time steps and for N=8 neurons. A filled-in circle represents a^ = 1, and an empty 
circle represents a^ = 0. The limit-cycle period is determined by searching for periodicity in Na{t). A 
'fingerprint' of the limit-cycle is then taken by measuring the time-averaged single- neuron firing rates, 
Ai, and also measuring the variance from the mean Bi for each of the neurons. Values of Na{t), Ai and 
\/Bi appropriate for this example are also shown in the figure. 



confidence level experiment. This similarity test corresponds to a tolerance of about 4 misfires per time 
step (for AW = 1000) From the x^-test, each pair of limit-cycles is given a difference label d{ts,t'g): 



d{ts.Q = 



(10) 



0, iix^{N.t,X)<N + iVN 

1, iix^{N.U,Q>N + ?,VN ■ 

If d(is, tj) ~ 1, Vi(, < tg, then the limit-cycle found at slow-time step, tg, is truly a novel limit-cycle, never 
having been observed before. If the limit-cycle is novel then it is given a 'novelty' label of n{tg) ~ 1, 
otherwise nitg) — (by default, the first observed limit-cycle will always be novel: n(l) = 1). Simply by 
counting the number of slow-time steps in which a novel limit-cycle is found, we can estimate the number 
of different limit-cycle attractors, Nd, available to the RSANN: 



Nd 



E n{tg) . 



(11) 



4 The performance of the random asymmetric neural network 

Random asymmetric neural networks will often develop into a fixed point where the neural firing vector, 
aiit), does not change in time, or in other words, the limit-cycle has a period of one time step. For zero 
slow-threshold noise (e = 0), if the mean threshold value is much greater(less) than normal, then the 
RSANN will tend to have a fixed point with very few(many) neurons firing each time step, which is called 
network death(epilepsy). Likewise, for zero noise (e = 0) and for normal thresholds (/^ = 1), limit-cycles 
with very long periods are possible (Figs.p|,0). 
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Figure 3: The period, L, of observed limit-cycles as a function of the global-thrcshold-level /i, for e = 0. 
(TV = 40 neurons; also note the logarithmic L-scale). 
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Figure 4: The mean (over time and space) neural firing rate, a, for each observed limit-cycle as a function 
of /x at e = 0. 
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When the mean threshold value is normal (/i = 1), but the spatiotemporal threshold fluctuations 
from normality are large (e > £2), then there also exist many different mixed death/epilepsy fixed points 
in which a fraction of the neurons are firing at each time step and the remaining neurons never fire. 
Conversely, when the mean threshold value is normal and the spatiotemporal threshold fiuctuations are 
small (e < ei), limit-cycles with very long periods are possible, but the number of different limit-cycle 
attractors is limited. For normal mean threshold values and intermediate- valued spatiotemporal threshold 
fluctuations (ei < e < 62), many intermediate-period limit-cycles exist (FigsJq,ra). 



4.1 Eligibility as a function of noise-strength 

A network is said to have a high degree of eligibility if many neurons participate in the dynamical 
collective activity of the network. For an attractor found at slow-time step is, the time-averaged spatial 
firing vector, Ai{ts) —< ai{t, ts) >tG [0, 1] (eq. ^, will be maximally efigible ii Ai(ts) — 0.5 for all neurons 
i, and minimally eligible if Ai(ts)Cz {0, 1} for all neurons i. The Shannon information (or entropy) has 
these properties, so we will adopt the form of an entropy function as our measure of the eligibility of each 
limit-cycle attractor, e{ts)'. 



1 ^ 



i=l 

where the average eligibility, £, per limit-cycle attractor is: 

jmax 

^ = ^ E e(is) < ^ In 2 = 0.3466 = £„,ax . (13) 

Despite its utility, we do not have a detailed dynamical motivation for using an entropy measure for 
our eligibility measure. In Figure R, we find that eligibility goes through a phase transformation to zero 
at 62 ~ 0.3, as the non-fixed-point limit-cycles gradually become fixed points as e increases. In other 
words, when the thresholds become grossly 'out-of-tune' with the mean membrane potential, the RSANN 
attractors become more trivial, with each neuron tending towards its own independent fixed point at — 1 
or a,; = 0. 



4.2 Diversity 

We measure the accessibility of a given attractor by estimating the probability, P{ts), that a given 
attractor (first seen at slow-time step ts, with the novelty label n{t'g) = 1 when t'^ = t^) is found during 
the slow-time observation period t^ e [l,i™^'^]: 

Pits) ^ ^ , (14) 

where N{ts) is the total number of times the limit-cycle tg (first observed at slow-time step tg) is observed, 



and n{ts) is defined in Section 3.2. Note that if a given attractor is only observed once (at time step ts), 
then P{ts) = l/ff^^; also if the same attractor is observed at each slow-time step, then P{ts = !) = !. 

If each different limit-cycle attractor can be accessed by the network with a measured probability. 
Pits), we can define the diversity, V, as the inter-attractor occupation entropy: 

^(C)=-E^(i.)lnP(ts), where ^ P(t,) = 1. (15) 

ts=l ts=l 

It is easily seen that a large T) corresponds to the ability to occupy many different cyclic modes with equal 
probability; the diversity will reach a maximum value oi V — I?max = Int™'^^, when P{t™'^^) = 1/t™'^'' 
for all slow-time steps t'^'^^. A small value for V corresponds to a genuine stability of the system - very 
few different cyclic modes are available. We observe a phase transformation from low to high diversity by 
increasing the level of randomness, e, on the threshold for each neuron past ei '--^ 5 x 10~^ (Fig- H)- We 
have chosen not to explicitly divide the diversity by i™^'^ or Int™'^^, since diversity should be an extensive 
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Figure 5: The period of the observed hmit-cycles, when averaged over slow-time for ts_max — 100 slow- 
time-steps, gradually decreases as the amplitude of the slow- noise increases, (/i = 1, iV = 40 neurons; 
note the logarithmic e-scale. 
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Figure 6: The total number of different limit-cycles observed (as determined from a x^-comparison) 
quickly approaches the total number of observations {ts,max = 100), as the slow- noise amplitude increases. 
The critical noise-amplitude is e w 10^'^. 
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Figure 7: The mean eligibility £ is shown as a function of the slow-noise amplitude e, exhibiting a phase 
transformation at e ~ 0.5 to low eligibility.. 

quantity, scaling with the observation time t™'^^. However, a diversity-production rate for the RSANN 
can easily be inferred, by dividing by the observation time. We have found very little dependence of the 
critical-point ei ~ 5 x 10^^ on the size of the network, TV. 



4.3 Volatility 

Volatility is defined as the ability to access a large number of highly-eligible limit-cycles, or a mixture 
of high eligibility and high diversity. We have defined eligibility and diversity above each in terms of 
entropy-type measure. Therefore we shall define volatility also as an entropy-weighted entropy: 



V = + ^e(i,)P(i,)lnP(i,) 



(16) 



For (ei < e < 62) (Fig. ^, volatility is high, corresponding to two distinct transformations to volatility. 
At e = ei ~ 5 X 10""', the amplitude of slow threshold noise causes a transformation to a diversity of 
different limit-cycles; at e = 62 '^ 5 x 10~^, the slow threshold noise is so large that all limit-cycles become 
fixed points. We accordingly label three different regimes for the RSANN with slow threshold noise: 

• Stable Regime: e < 5 x 10^'' 

• Volatile Regime: 5 x 10"^ < e < 5 x 10"^ 

• Trivially Random Regime: e > 5 x 10^^. 



4.4 Net Size Dependence of Limit-Cycle Period and Number of Different 
At tractors 

From Table ll for several different network sizes {N < 50) with M ~ 10 without slow threshold noise 
(e = 0), we have found only a handful of different limit-cycles (N^ < 6) for each network, without evidence 
for a systematic dependence on network size. The limit-cycle periods for these networks at zero noise are 
dominated by one or two different periods (typ(i)), and also have no systematic dependence on network 
size. We have found however that the transients (typ(W„_i)) prior to convergence to a limit-cycle tends 
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Figure 8: The diversity, an entropy-measure of number of different limit-cycles, shows a phase transfor- 
mation to maximal diversity at a slow-noise amplitude e « 0.0005 {N = 40 neurons). The maximum 
diversity for t™"^ — 100 slow-time steps is Vmax = In 100 w 4.6. 
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Figure 9: The volatility is large and nearly maximal only within a broad range of slow-noise amplitudes: 
5 X 10"'' < e < 0.5 (A^ == 40 neurons, and tf"-"" = 100). The maximal volatility for i^"^ = 100 slow-time 
steps is Vn 



-max - ^ In 2 In 100= 1.5960. 
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grow very rapidly with network size N. When e = 0.01, which is in the volatile region, the distribution 
of cycle lengths is broadly distributed (see Fig pi]), and from Table ||, the mean value iave of the cycle 
length grows nearly exponentially with N (Fig. |10| ). Since the distribution of limit-cycle periods is highly 
non-gaussian (Fig.O) , caution should be used when interpreting the properties of the average cycle- length 
(as in Fig. pl3| ). Potentially the maximum or median observed cycle length should be used rather than 
the average. Also, since the cycle length distribution does not exhibit peaks at regularly spaced intervals, 
the possibility of an errant limit-cycle comparison algorithm is unlikely. 





£==0 


e = 


e = 


e = 0.01 


N 


Nd 


char(L) 


char(VK„_i) 


<L> 


10 


6 


3 


128 


2.8 ± 0.06 


20 


3 


142 


512 


46 ±5 


30 


4 


9 


128 


98 ±9 


40 


1 


688 


2048 


361 ± 32 


50 


5 


2 


4096 


1886 ± 161 



Table 1: For different network sizes, N, we tabulate the number, Nd, of different zero- noise limit-cycle 
attractors, characteristic cycle length (char(L(e — 0)), characteristic transient (char(H/„_i(e = 0)), and 
average cycle length with non-zero noise {< L > {e — 0.01)). Each error bar is the R.M.S. variation from 
the mean divided by the square root of the number of initial-conditions. At each value of e, we observe 
each net for t^""^ = 100 slow-time steps, in which we require greater than P = 2 periods (see Section 3.2) 
of limit-cycle repetition before searching for another limit-cycle. 



V 



3.5 



2.5 



1-5 



0.5 




_i I I i_ 



_i I I I I I i_ 



_J I I I I I I I I I I 



10 



IS 



20 



25 



30 

N 



35 



40 



45 



50 



Figure 10: The logarithm (base 10) of the mean-cycle length (within the volatile regime, e = 0.01) 
increases somewhat linearly with the size of the neural network, possibly implying that the volatile 
RSANNs are in the chaotic phase. 
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Figure 11: The distribution of different limit-cycle periods observed in the volatile regime (for N — 40, 
P^2 (see Section pi), e = 0.01). 



4.5 Observation Period-Length Dependence of Number of Different Attrac- 
tors 

We observe in the volatile-regime, that the number of different attractors observed, Nd, is nearly equal 
to the observation time-period t^^^, when e > 5 x 10^"^. Conversely, in the stable-regime (e < 5 x 10~^), 
Nd is largely independent of t'^'^^. These two results are complementary: the former implying a nearly 
inexhaustible source of different highly-eligible limit-cycle attractors, the latter implying that we can 
access a small group of different limit-cycle attractors with a high degree of predictability. Nd is often 
greater than 1 (though small) for the stable-regime, which means that the stable phase cannot be used 
to access a particular attractor upon demand, but we can demand access to one of a small number of 
different attractors. One might interpret this result as showing that the RSANN can think the same 
thought in several different ways, dependent on the initial conditions for the firing vector, ai{t = 0,ts). 



5 Conclusions and Summary 

5.1 Comparison with other work 

Kiirten (1988a) has shown the existence of a dynamical phase transition for zero-noise RSANNs with 
K ~ 3 incoming connections per neuron from a chaotic phase to a frozen phase. For K < 3, RSANNs 
will always remain in the frozen phase. For K = 3, the chaotic-to-frozen transition can be triggered either 
by randomly diluting the density of connections, or by increasing an additive threshold parameter. In 
the chaotic phase, the RSANN has sensitive dependence on initial conditions, and very long limit-cycle 
trajectories (whose period scales as L ex 2^'^). In the frozen phase, the RSANN has insensitivity to initial 
conditions and very short limit-cycle trajectories (whose period scales as L ex N"). The parameters a 
and p depend on the connectivity K, the additive threshold parameter, and the distribution of connection 
strengths. Therefore, at zero threshold noise (e = 0), our results are inconclusive; however when we choose 
our thresholds from a sufRcently wide distribution (e = 0.01), the limit-cyc le p eriod scales approximately 
as an exponential function of N (with an exponent of /3 ~ 0.2, see section 14), so we might (cautiously) 
surmise that the volatile RSANN is in the chaotic phase. 

Kauffman (1993, pp. 191-235) and Kiirten (1988b) shows that random boolean automata with K = 2 
(frozen phase) typically have Nd oc N^^^ different limit-cycle attractors (for each network realization). 
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whose period also scales as L oc N'^l'^. This small number of different attractors is qualitatively consistent 
with our e = results. We need to perform an ensemble average of many simulations to indeed confirm 
this result. We are currently unaware of any definitive prior results on the number of different attractors 
for networks in the chaotic phase (except for the observed preponderance of a very few (long) limit-cycles, 
perhaps explained by 'canalization' (Kauffman, 1993). However, the arguments of Derrida, Gardner, and 
Zippelius(1987) regarding the evolution of the overlap between a configuration and a stored configuration 
might apply, which would imply a strict theoretical upper limit on the number of storablc/rccallable 
limit-cycle attractors at N^^^ = 2N. However, we do not keep our thresholds fixed, so this upper limit 
is not applicable, as seen in our results. 

For our implementation of noisy RSANNs, we speculate that the number of attractors in the chaotic 
phase scales exponentially with TV. This speculation is based on our observation that with our volatile 
RSANN, the number of different attractors available at e = 0.01 is nearly inexhaustible since in the 
volatile phase we are always able to observe new limit-cycle attractors just by giving the thresholds new 
initial conditions from the narrow gaussian distribution. 

5.2 Volatility, Chaos, Stochastic Resonance, and Qualitative Non-Determinism 

Our original interpretation of e > as providing a slowly-varying noise on the thresholds can be reinter- 
preted in a slightly different perspective. The volatile RSANNs are probably in the chaotic phase even 
when e = 0, but in order to observe the expected exponential dependence of the cycle-length on iV, we 
would need to perform an ensemble average (or observe many different realizations of the RSANN from 
the same class with different connection matrices). When e > 0, we are actually sampling a significant 
fraction of the entire ensemble. Noise can give a dynamical system access to the whole ensemble of dif- 
ferent behaviors at different times during the lifetime of the dynamical system. Slowly- varying threshold 
noise can act as a 'scanner' for thoughts novel or long-lost. 

Volatility can also be considered as a form of stochastic resonance, in which an optimal noise amplitude 
enhances the signal-to-noise ratio of a signal filter. Zero-noise or high-amplitude noise tends to reduce 
the information-processing capability of a stochastic resonant system. The observation of stochastic 
resonance without external driving force (Gang et al., 1993) has interesting parallels to our observation 
of high volatility at intermediate noise amplitudes. 

By taking advantage of the chaotic threshold parameters (the connection strength parameters are 
probably also chaotic), we can access a large number of different RSANN attractors. Hence with a 
feedback algorithm, one might be able to construct a system to control this chaos (Ott, Grebogi & Yorke, 
1990) and access a given attractor upon demand. But this stability needs to be augmented by the ability 
to always be able to access a novel attractor. This approach to controlled creativity has been developed 
into the adaptive resonance formalism (Carpenter & Grossberg, 1987). There is a theoretical proof 
(Amit, 1989, p. 66) that thresholds with fast-noise (Little, 1974) (chosen from a zero-mean gaussian) 
and sharp step-function non-linearities is equivalent to a system with zero threshold noise but with a 
rounded 'S'-curve non-linearity. This proof does not apply to slowly varying threshold noise. Perhaps 
by choosing a discontinuous non-linearity, with additive noise in the argument of the non-linearity, the 
volatility or creativity that we observe is due to non-determinism (Hiibler, 1992), in which prediction of 
final limit-cycle attractors is nearly impossible. The notion of 'qualitatively' uncertain dynamics (Heagy, 
Carroll & Pecora, 1994) describes non-determinism between different attractor basins. Qualitative non- 
determinism differs from the effective quantitative non-determinism observed in ordinary deterministic 
chaos, in that ordinary chaos consists of a single 'strange' attractor, while qualitative non-determinism 
consists of multiple strange (or simple) attractors 'riddled' with holes for transitions to other attractors. 
Volatility is precisely the same concept as qualitative non-determinism. 

5.3 Summary 

The main objective of this study has been to construct a volatile neural network that could exhibit a 
large set of easily- accessible highly-eligible limit-cycle attractors. Without noise, we demonstrate that 
random asymmetric neural networks (RSANNs) can exhibit only a small number of different limit-cycle 
attractors. With neuronal threshold noise within a rather wide range (ei < e < 62), we show that 
RSANNs can access a diversity of highly-eligible limit-cycle attractors. RSANNs exhibit a diversity 
phase transformation from a small number of distinct limit-cycle attractors to a large number at a noise 
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amplitude of e = ei ^ 10~^. Likewise, RSANNs exhibit a eligibility phase transformation at a threshold 
noise amplitude of e = 62 ^ 0.5. 

Acknowledgements 

H. Bohr would like to thank P. Carruthcrs (now deceased), J. Rafelski, and the U. Arizona Department 
of Physics for hospitality during several visits when much of this work was completed; P. McGuire thanks 
the Santa Fe Institute and A. Hiibler and the University of Illinois Center for Complex Systems Research 
for hospitality and atmospheres for very fertile discussions. P. McGuire was partially supported by an 
NSF/U.S. Dept. of Education/State of Arizona pre-doctoral fellowship. We all thank many individuals 
who have provided different perspectives to our work, including the following: G. Sonnenberg, D. Harley, 
B. Skaggs, Z. Hasan, G. Littlewort, and J. Clark. 



References 

[1] D.J. Amit. Modelling Brain Function: The World of Attractor Neural Networks (Cambridge Univ. 
Press: Cambridge, 1989). 

[2] P. C. Bressloff and J. G. Taylor. "Random Iterative Networks," Kings College preprint July 1989, 
London. 

[3] G.A. Carpenter and S. Grossberg. "ART 2: Self-organization of Stable Category Recognition Codes 
for Analog Input Patterns," Applied Optics 26 (1987) 4919. 

[4] J.W. Clark, "Long-term Behavior of Neural Networks," Relaxation Complex Systems and Related 
Topics, eds. I. Campbell and C. Giovannella (Plenum: New York, 1990) 205. 

[5] J.W. Clark. "Neural Network Modelling," Phys. Med. Biol. 36 (1991) 1259. 

[6] J.W. Clark, K.E. Kiirten and J. Rafelski. "Access and stability of Cyclic Modes in Quasirandom 
Networks of Threshold Neurons Obeying a Determinisitic Synchronous Dynamics," Computer Sim- 
ulation in Brain Science, edited by R.M.J Cotterill (Cambridge Univ. Press:Cambridge,1988) 316. 

[7] J.W. Clark, J. Rafelski and J.V. Winston. "Brain Without Mind: Computer Simulation of Neural 
Networks with Modifiable Neuronal Interactions," Phys. Rep. 123 (1985) 215. 

[8] B. Derrida, E. Gardner, and A. Zippelius. "An Exactly Solvable Asymmetric Neural Network Model," 
Europhys. Lett. 4 (1987) 167. 

[9] P. Faure, "A Non-random Dynamic Component in the Synaptic Noise of a Central Neuron," Proc. 
N.A.S., 94 (1997) 6506. 

[10] H. Gang, T. Ditzinger, C.Z. Ning, H. Haken. "Stochastic Resonance without External Periodic 
Force", Phys. Rev. Lett.71 (1993) 807. 

[11] Z. Hasan, " Biomechanical Complexity and the Control of Movement," Lectures in the Sciences of 
Complexity, edited by D.L. Stein (Santa Fe Institute Studies in the Sciences of Complexity, Addison- 
Wesley) (1989) 841. 

[12] J.F. Heagy, T.L. Carroll and L.M. Pecora, "Experimental and Numerical Evidence for Riddled Basins 
in Coupled Chaotic Systems," Phys. Rev. Lett. 73 (1994) 3528. 

[13] J.J. Hopfield. "Neural Networks and Physical Systems with Emergent Collective Computational 
Abilities," Proc. Natl. Acad. Set. USA 79 (1982) 2554. 

[14] A. Hiibler. "Modelling and Control of Complex Systems: Paradigms and Applications", U. Illinois 
CCSR Tech Report 92-12 (1992). 

[15] Stuart A. Kauffman The Origins of Order: Self- Organization and Selection in Evolution, Oxford 
University Press (1993). 



16 Hcnrik Bohr, Patrick McGuirc, Chris Pershing and Johann Rafelski 

[16] K.E. Kiirten, "Critical Phenomena in Model Neural Networks", Phys. Lett. A129 (1988a) 157. 

[17] K.E. Kiirten, "Correspondence between Neural Threshold Networks and Kauffman Boolean CuUular 
Automata," J. Phys. A21 (1988b) L615. 

[18] W.A. Little. "The Existence of Persistent States in the Brain," Math. Biosci. 19 (1974) 101. 

[19] G.C. Littlewort, J.W. Clark and J. Rafelski. "Transition to Cycling in Neural Networks," Computer 
Simulation in Brain Science, edited by R.M.J Cotterill (Cambridge Univ. Press:Cambridge,1988), 
345 

[20] E. Marder and S.L. Hooper, "Neurotransmitter Modulation of the Stomatogastric Ganglion of De- 
capod Crustaceans," Model Neural Networks and Behavior, Ed A.I. Selverston (Plenum Press: New 
York, 1985), 319. 

[21] P.C. McGuire, G.C. Littlewort and J. Rafelski, "Brainwashing Random Asymmetric 'Neural' Net- 
works," Phys. Lett. A160 (1991) 255. 

[22] P.C. McGuire, G.C. Littlewort, C. Pershing and J. Rafelski, "Training Random Asymmetric 'Neural' 
Networks Towards Chaos - A Progress Report," Proceedings of the Workshop on Complex Dynamics 
in Neural Networks,edited by J.G Taylor, E.R. Caianiello, R.M.J. Cotterill and J.W. Clark ( Springer- 
Verlag, London, 1992) pp. 90-102. 

[23] W.S. McCuUoch and W. Pitts. "A Logical Calculus of the Ideas Immanent in Nervous Activity," 
Bull. Math. Biophys. 5 (1943) 115. 

[24] E. Ott, C. Grebogi and J.A. Yorke, "Controlling Chaos," Phys. Rev. Lett. 64 (1990) 1196. 

[25] X. Pei, K. Bachmann and F. Moss, "The Detection Threshold, Noise, and Stochastic Resonance in 
the Fitzhugh-Nagumo model," Physics Letters A206, (1995) 61. 

[26] R.H. Rand, A.H. Cohen and P.J. Holmes, "Systems of Coupled Oscillators as Models of Central 
Pattern Generators," Neural Control of Rhythmic Movements in Vertebrates, Eds. A.H. Cohen, S. 
Rossignol, and S. Grillner (John Wiley: New York, 1988), 333. 

[27] T.P. Smith, F.W. Hersman, and A.Zondervan, "Analysis of Sparsely Distributed Data: An Applica- 
tion of the Extended Maximum-Likelihood Method," Nucl.Instr.Meth. A334 (1993) 537. 



